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(54) Improved video conference data transfer system 



(57) The present invention provides a system for 
transferring multiplexed data including image data and 
voice data through at least a communication line 
between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 
nication line ; and a controller unit for controlling trans- 
fers of the image data and the voice data, so that a 
priority is given to the transfer of the voice data whilst 
the transfer of the image data is controlled or discontin- 
ued in order to continue a current transfer of the voice 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 

I : first terminal device 2 : first microphone 
3 : first camera 4 ; first speaker 

5 : first display 6 : first data compressor 

7 : first data decompressor 8 : first multiplexer 

9 : first demultiplexer 10-1 : first data controller 

II : first transmitting side data buffer 12 : first receiving side data buffer 
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15 : second terminal device 16 : second communication device 

17 : second transmitting side daU buffer 

18 : second receiving side data buffer 

19-1 : second data controller 20 : second multiplexer 
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23 : second data decompressor 7A : second microphone 
25 : second camera 25 : second speaker 

27 ; second display 

CM 
< 

LO 
CO 
CO 

r>» 

o> 
o 
Q_ 

LU 

Printed by Xerox (UK) Business Services 
2.16.7/3.6 



J 



Europaisches Patentamt 

(19) nm European Patent Office 

Office europeen des brevets 



FIG. 2 



r 

uu 



/ 



\ 8 AT ,2 0 ,2 2 



2 5 
2 S 

, L 



1 



EP 0 917 365 A2 



2 



Description 

[0001] The present invention relates to an improve- 
ment of a video conference data transfer system, and 
more particularly to an improvement of a video confer- 
ence data transfer system for transferring image data 
and voice data on networks. 

[0002] Video conferences have already been held by 
transferring image data and voice data through commu- 
nication lines between terminal devices such as per- 
sonal computers. FIG. 1 is a block diagram illustrative of 
a conventional video conference data transfer system 
for transferring image data and voice data for the video 
conference. The conventional video conference data 
transfer system comprises two terminal devices 51 and 
65 and a communication line 63 connecting the two ter- 
minal devices 51 and 65 to each other or transferring 
image data and voice data for the video conference. 
The two terminal devices 51 and 65 will be referred to as 
a first terminal device 51 and a second terminal device 
65 which have the same structure and configurations. 
The first and second terminal devices 51 and 65 have 
first and second microphones 52 and 72 respectively for 
capturing voices. The first and second terminal devices 
51 and 65 also have first and second cameras 53 and 
73 respectively for capturing images. The first and sec- 
ond terminal devices 51 and 65 also have first and sec- 
ond data compressors 56 and 70 respectively. The first 
compressor 56 is connected to the first microphone 52 
and the first camera 53 for receiving image data cap- 
tured by the first camera 53 and voice data captured by 
the first microphone 52 to compress the received image 
data and the received voice data. The second compres- 
sor 70 is also connected to the second microphone 72 
and the first camera 73 for receiving image data cap- 
tured by the second camera 73 and voice data captured 
by the second microphone 72 to compress the received 
image data and the received voice data. The first and 
second terminal devices 51 and 65 also have first and 
second multiplexers 58 and 68 respectively for multi- 
plexing image data and voice data. The first multiplexer 
58 is connected to the first data compressor 56 for 
receiving the compressed image data and the com- 
pressed voice data from the first data compressor 56 to 
multiplex the compressed image data and the com- 
pressed voice data. The second multiplexer 68 is con- 
nected to the second data compressor 70 for receiving 
the compressed image data and the compressed voice 
data from the second data compressor 70 to multiplex 
the compressed image data and the compressed voice 
data. The first and second terminal devices 51 and 65 
also have first and second transmission data buffers 60 
and 66 respectively for temporary storing the multi- 
plexed data. The first transmission data buffer 60 is con- 
nected to the first multiplexer 58 for receiving and 
temporary storing the multiplexed data. The second 
transmission data buffer 66 is connected to the second 
multiplexer 68 for receiving and temporary storing the 



multiplexed data. The first and second terminal devices 
51 and 65 also have first and second communication 
devices 62 and 64 respectively. The first and second 
communication devices 62 and 64 are connected to 

5 each other through the communication line 63. The first 
communication device 62 is connected to the first trans- 
mission data buffer 60 for receiving the first multiplexed 
data from the first transmission data buffer 60 to trans- 
mit the first multiplexed data through the communication 

10 line 63 to the second communication device 64. On the 
other hand, the second communication device 64 is 
connected to the second transmission data buffer 66 for 
receiving the second multiplexed data from the second 
transmission data buffer 66 to transmit the second mul- 

15 tiplexed data through the communication line 63 to the 
first communication device 62. The first communication 
device 62 receives the second multiplexed data from the 
second communication device 64, whilst the second 
communication device 64 receives the first multiplexed 

20 data from the first communication device 62. The first 
and second terminal devices 51 and 65 further have first 
and second receiving data buffers 61 and 67 respec- 
tively for temporary storing the received data. The first 
receiving data buffer 61 is connected to the first commu- 

25 nication device 62 for receiving the second multiplexed 
data from the first communication device 62 to tempo- 
rary store the second multiplexed data. The second 
receiving data buffer 62 is connected to the second 
communication device 64 for receiving the first multi- 

30 plexed data from the second communication device 64 
to temporary store the first multiplexed data. The first 
and second terminal devices 51 and 65 further have first 
and second demultiplexers 59 and 69 respectively for 
separating the multiplexed data into voice and image 

35 data. The first demultiplexer 59 is connected to the first 
receiving data buffer 61 for receiving the second multi- 
plexed data to demultiplex the second multiplexed data 
into second image data and second voice data sepa- 
rated from each other. The second demultiplexer 69 is 

40 connected to the second receiving data buffer 67 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 
terminal devices 51 and 65 further have first and second 

45 decompressors 57 and 69 respectively for decompress- 
ing the image data and the voice data separately. The 
first decompressor 57 is connected to the first demulti- 
plexer 59 for receiving the second image data and the 
second voice data to expend the second image data 

so and the second voice data separately. The second 
decompressor 71 is connected to the second demulti- 
plexer 69 for receiving the first image data and the first 
voice data to expend the first image data and the first 
voice data separately. The first and second terminal 

55 devices 51 and 65 further have first and second speak- 
ers 54 and 74 as well as first and second displays 55 
and 75 respectively for re-producing the voice data and 
the image data. The first speaker 54 is connected to the 
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first decompressor 57 for receiving the second voice 
data from the first decompressor 57 to reproduce the 
second voice data as a voice. The first display 55 is also 
connected to the first decompressor 57 for receiving the 
second image data from the first decompressor 57 to 5 
reproduce the second image data on a screen of the 
first display 55. The second speaker 74 is connected to 
the second decompressor 71 for receiving the first voice 
data from the second decompressor 71 to reproduce 
the first voice data as a voice. The second display 75 is w 
also connected to the second decompressor 71 for 
receiving the first image data from the second decom- 
pressor 71 to reproduce the first image data on a screen 
of the second display 75. 

[0003] In Japanese laid-open patent publication No. 4- is 
58687, a method of controlling an amount of generated 
codes is disclosed, wherein a capacity of a data trans- 
mission buffer is supervised to control an amount of 
generation of image codes for controlling the amount of 
data. This publication is, however, silent on a control to 20 
the voice data. 

[0004] In Japanese laid-open patent publication No. 9- 
1 16885, an apparatus and a method of management of 
a communication load of a television conference system 
as well as a terminal device if the television conference 25 
system are disclosed, wherein a plurality of terminal 
devices are located at different places and connected 
through communication lines to each other. Loads on 
communications of the communication lines are super- 
vised so that if the load is over a predetermined value, 30 
then a priority is given to the display of images and 
voices of a person which is not speaking. This publica- 
tion does not address changing voice and image data 
formats for continuation of the television conference. 
[0005] The existent communication lines for transfer- 35 
ring the compressed and multiplexed data for the video 
conference may comprise various types of commination 
lines, for example, high speed communication lines 
such as ISDN and ATM and general lines such as 
POTS. Although the high speed communication lines 40 
such as ISDN and ATM are of course preferable, those 
high speed communication lines are still minor and the 
majority communication lines are the general lines such 
as POTS. 

[0006] The general lines such as POTS have a low 45 
capacity of transferring data, for which reason a large 
size of the general lines is thus required to transfer a 
large amount of data at the required high speed. The 
image data and the voice data are once compressed in 
the transmitter side terminal device for transmission of so 
the compressed data to the receiving side terminal 
device before the receiving side terminal device decom- 
presses the compressed image and voice data to repro- 
duce the image and voice data separately. The data 
transfer rate of the general communication line POTS is ss 
insufficient for smoothly reproducing the image data 
and the voice data so that discontinuations of the image 
and voice may appear during the video conference and 



the re-produced image on the display and the re-pro- 
duced voice from the speaker are asynchronous with 
each other. 

[0007] Actually, however, it might be possible to con- 
tinue the conference even if the image and the voice are 
asynchronous with each other although it is of course 
undesirable. It might also be possible to continue the 
conference via the voice only even if the image is dis- 
continued although it is of course undesirable. Notwith- 
standing, it might be difficult to continue the conference 
via the image only when the voice is discontinued. 
[0008] So long as the general communication lines 
are used for the video conference system, it is difficult to 
solve the above problems with the insufficient transfer 
rate for smooth re-production of the image data and the 
voice data without my discontinuation. In order to con- 
tinue the video conference, it is essential to continue the 
transfer of at least the voice data, for which reason if the 
required transfer rate of data to be transferred on the 
communication line exceeds the capacity of the commu- 
nication line, or if the terminal device has an over-load, 
then a priority is given to the transfer of the voice data to 
continue the transfer of at least the voice data even the 
transfer of the image data is discontinued. 
[0009] In the above circumstances, it had been 
required to develop an improved video conference sys- 
tem for transferring video data and image data free from 
the above problems. 

[001 0] Accordingly, it is an object of the present inven- 
tion to provide an improved video conference system for 
transferring video data and image data from the above 
problems. 

[001 1] It is a further object of the present invention to 
provide an improved video conference system for so 
transferring video data and image data as to permit a 
continuation of video conference even if the currently 
required data transfer rate is beyond a current capacity 
of a general communication line in use. 
[001 2] It is a still further object of the present invention 
to provide an improved video conference system which 
has a plurality of image data formats and a plurality of 
video data formats so that if the currently required data 
transfer rate is beyond a current capacity of a general 
communication line in use, then the currently used 
image data format and voice format are changed so as 
to continue the transfer of the voice data for permitting a 
continuation of video conference. 
[001 3] It is yet a further object of the present invention 
to provide an improved video conference system for so 
transferring video data and image data as to permit a 
continuation of video conference even if a CPU enters 
into an over-load state. 

[001 4] It is a further more object of the present inven- 
tion to provide an improved video conference system 
which has a plurality of image data formats and a plural- 
ity of video data formats so that if a CPU enters into an 
over-load state, then the currently image data process- 
ing rate is decreased to continue the transfer of the 
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voice data for permitting a continuation of video confer- 
ence. 

[001 5] It is still more object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line 
between terminal devices for implementation of a video 
conference free from the above problem. 
[001 6] It is moreover object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line 
between terminal devices for implementation of a video 
conference so as to permit a continuation of video con- 
ference even if the currently required data transfer rate 
is beyond a current capacity of a general communica- 
tion line in use. 

[0017] It is another object of the present invention to 
provide a novel method of controlling transfers of video 
data and image data through a communication line 
between terminal devices for implementation of a video 
conference, so that if the currently required data transfer 
rate is beyond a current capacity of a general communi- 
cation line in use, then the currently used image data 
format and voice format are changed so as to continue 
the transfer of the voice data for permitting a continua- 
tion of video conference. 

[0018] It is still another object of the present invention 
to provide a novel method of controlling transfers of 
video data and image data through a communication 
line between terminal devices for implementation of a 
video conference so as to permit a continuation of video 
conference even if a CPU enters into an over-load state. 
[001 9] It is yet another object of the present invention 
to provide a novel method of controlling transfers of 
video data and image data through a communication 
line between terminal devices for implementation of a 
video conference so that if a CPU enters into an over- 
load state, then the currently image data processing 
rate is decreased to continue the transfer of the voice 
data for permitting a continuation of video conference. 
[0020] The first present invention provides a system 
for transferring multiplexed data including image data 
and voice data through at least a communication line 
between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 
nication line ; and a controller unit for controlling trans- 
fers of the image data and the voice data, so that a 
priority is given to the transfer of the voice data whilst 
the transfer of the image data is controlled or discontin- 
ued in order to continue a current transfer of the voice 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 

[0021] The second present invention provides a sys- 
tem for transferring multiplexed data including image 
data and voice data through at least a communication 
line between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a load of a 



processor provided in each of the terminal devices ; and 
a controller unit for controlling processing speeds of the 
image data and the voice data, so that the priority is 
given to the processing of the voice data whilst the 
5 processing of the image data is controlled or discontin- 
ued in order to continue the current processing speed of 
the voice data when the monitoring unit recognizes an 
over-load of the processor. 

[0022] The above and other objects, features and 
10 advantages of the present invention will be apparent 
from the following descriptions. 
[0023] Preferred embodiments according to the 
present invention will be described in detail with refer- 
ence to the accompanying drawings. 

15 

FIG. 1 is a block diagram illustrative of the conven- 
tional video conference data transfer system for 
transferring image data and voice data for the video 
conference. 

20 FIG. 2 is a block diagram illustrative of a novel video 
conference system for transferring image data and 
voice data through a general communication line 
between two terminal devices in a first embodiment 
in accordance with the present invention. 

25 FIG. 3 is a block diagram illustrative of a novel video 
conference system for transferring image data and 
voice data through a general communication line 
between two terminal devices in a second embodi- 
ment in accordance with the present invention. 

30 

[0024] The first present invention provides a system 
for transferring multiplexed data including image data 
and voice data through at least a communication line 
between at least two terminal devices. The system 

35 includes : a monitoring unit for monitoring a current 
state of transfer of the multiplexed data on the commu- 
nication line ; and a controller unit for controlling trans- 
fers of the image data and the voice data, so that a 
priority is given to the transfer of the voice data whilst 

40 the transfer of the image data is controlled or discontin- 
ued in order to continue a current transfer of the voice 
data when the monitoring unit recognizes a delay in 
transfer of the multiplexed data on the communication 
line. 

45 [0025] It is preferable that the controller unit controls 
the current transfer of the voice data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even 
after the transfer of the image data is discontinued. 

so [0026] It is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 
accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 

55 in the data storage unit exceeds a predetermined level, 
then the controller unit performs the control operation. 
[0027] It is also preferable that the controller unit con- 
trols the transfer of the image data by changing an orig- 
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inal image data format defining a first data transfer rate 
as a normal data transfer rate to other image data for- 
mat defining a second data transfer rate which is lower 
than the first data transfer rate when the monitoring unit 
recognizes the delay in transfer of the multiplexed data 
on the communication line. 

[0028] It is further preferable that the controller unit 
further controls the transfer of the image data by return- 
ing the other image data format into the original image 
data format when the monitoring unit recognizes no 
delay in transfer of the multiplexed data on the commu- 
nication line. 

[0029] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by further 
changing the other image data format into still other 
image data format defining a third data transfer rate 
which is lower than the second data transfer rate when 
the monitoring unit still recognizes the delay in transfer 
of the multiplexed data on the communication line. 
[0030] It is further preferable that the controller unit 
further controls the transfer of the image data by return- 
ing the still other image data format into the other image 
data format when the monitoring unit recognizes no 
delay in transfer of the multiplexed data on the commu- 
nication line. 

[0031] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by discontin- 
uing the transfer of the image data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even 
after the controller unit changes the image data format 
into a final image data format defining a lowest data 
transfer rate. 

[0032] It is further preferable that the controller unit 
further controls the transfer of the image data by re- 
starting the image data transfer when the monitoring 
unit recognizes no delay in transfer of the multiplexed 
data on the communication line. 
[0033] It is also preferable that the monitoring unit and 
the controller unit are realized by a data controller pro- 
vided in each of the terminal devices. 
[0034] It is also preferable that monitoring unit further 
monitors a load of a processor provided in each of the 
terminal devices for permitting the controller unit to con- 
trol processing speeds of the image data and the voice 
data by the processor, so that the priority is given to the 
processing of the voice data whilst the processing of the 
image data is controlled or discontinued in order to con- 
tinue the current processing speed of the voice data 
when the monitoring unit recognizes an over-load of the 
processor. 

[0035] It is also preferable that the controller unit con- 
trols the current processing speed of the voice data only 
when said controller still recognizes said over-load of 
said processor even after the processing of the image 
data has been discontinued. 

[0036] It is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 



accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 
in the data storage unit is less than a predetermined 
5 level, then the controller unit performs the control oper- 
ation. 

[0037] It is also preferable that the controller unit con- 
trols the processing speed of the image data by chang- 
ing an original image data processing speed format 

10 defining a first data processing speed as a normal data 
processing speed to other image data processing 
speed format defining a second data processing speed 
which is lower than the first data processing speed 
when the monitoring unit recognizes the over-load of 

15 the processor. 

[0038] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
returning the other image data processing speed format 
into the original image data processing speed format 

20 when the monitoring unit recognizes no over-load of the 
processor. 

[0039] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
further changing the other image data processing 

25 speed format into still other image data processing 
speed format defining a third data processing speed 
which is lower than the second data processing speed 
when the monitoring unit still recognizes the over-load 
of the processor. 

30 [0040] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
returning the still other image data processing speed 
format into the other image data processing speed for- 
mat when the monitoring unit recognizes no over-load 

35 of the processor. 

[0041] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
discontinuing the processing of the image data only 
when the monitoring unit still recognizes the over-load 

40 of the processor even after the controller unit changes 
the image data processing speed format into a final 
image data processing speed format defining a lowest 
data processing speed. 

[0042] It is also preferable that the controller unit fur- 
45 ther controls the processing speed of the image data by 
re-starting the still other image data compression 
processing when, the monitoring unit recognizes no 
over-load of the processor. 

[0043] It is also preferable that the controller unit con- 
so trols the processing speed of the image data by control- 
ling an operation of a compressor provided each of the 
terminal devices. 

[0044] The second present invention provides a sys- 
tem for transferring multiplexed data including image 
55 data and voice data through at least a communication 
line between at least two terminal devices. The system 
includes : a monitoring unit for monitoring a load of a 
processor provided in each of the terminal devices ; and 
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a controller unit for controlling processing speeds of the 
image data and the voice data, so that the priority is 
given to the processing of the voice data whilst the 
processing of the image data is controlled or discontin- 
ued in order to continue the current processing speed of 5 
the voice data when the monitoring unit recognizes an 
over-load of the processor. 

[0045] It is preferable that the controller unit controls 
the current processing speed of the voice data only 
when said controller still recognizes said over-load of 
said processor even after the processing of the image 
data has been discontinued. 

[0046] It is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 
accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 
in the data storage unit is less than a predetermined 
level, then the controller unit performs the control oper- 
ation. 

[0047] It is also preferable that the controller unit con- 
trols the processing speed of the image data by chang- 
ing an original image data processing speed format 
defining a first data processing speed as a normal data 
processing speed to other image data processing 
speed format defining a second data processing speed 
which is lower than the first data processing speed 
when the monitoring unit recognizes the over-load of 
the processor. 

[0048] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
returning the other image data processing speed format 
into the original image data processing speed format 
when the monitoring unit recognizes no over-load of the 
processor. 

[0049] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
further changing the other image data processing 
speed format into still other image data processing 
speed format defining a third data processing speed 
which is lower than the second data processing speed 
when the monitoring unit still recognizes the over-load 
of the processor. 

[0050] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
returning the still other image data processing speed 
format into the other image data processing speed for- 
mat when the monitoring unit recognizes no over-load 
of the processor. 

[0051] It is also preferable that the controller unit fur- 
ther controls the processing speed of the image data by 
discontinuing the processing of the image data only 
when the monitoring unit still recognizes the over-load 
of the processor even after the controller unit changes 
the image data processing speed format into a final 
image data processing speed format defining a lowest 
data processing speed. 

[0052] It is also preferable that the controller unit fur- 



ther controls the processing speed of the image data by 
re-starting the still other image data compression 
processing when the monitoring unit recognizes no 
over-load of the processor. 

[0053] It is also preferable that the controller unit con- 
trols the processing speed of the image data by control- 
ling an operation of a compressor provided each of the 
terminal devices. 

[0054] It is also preferable that the monitoring unit fur- 
ther monitors a current state of transfer of the multi- 
plexed data on the communication line so as to permit 
the controller unit to further control transfers of the 
image data and the voice data, so that a priority is given 
to the transfer of the voice data whilst the transfer of the 
image data is controlled or discontinued in order to con- 
tinue a current transfer of the voice data when the mon- 
itoring unit recognizes a delay in transfer of the 
multiplexed data on the communication line. 
[0055] It is also preferable that the controller unit con- 
trols the current transfer of the voice data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even the 
transfer of the image data is discontinued. 
[0056] It is also preferable that the monitoring unit is 
operated to monitor an amount of the multiplexed data 
accumulated in a data storage unit for subsequent 
transfer through the communication line so that only 
when the amount of the multiplexed data accumulated 
in the data storage unit exceeds a predetermined level, 
then the controller unit performs the control operation. 
[0057] It is also preferable that the controller unit con- 
trols the transfer of the image data by changing an orig- 
inal image data format defining a first data transfer rate 
as a normal data transfer rate to over image data format 
defining a second data transfer rate which is lower than 
the first data transfer rate when the monitoring unit rec- 
ognizes the delay in transfer of the multiplexed data on 
the communication line. 

[0058] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by returning 
the other image data format into the original image data 
format when the monitoring unit recognizes no delay in 
transfer of the multiplexed data on the communication 
line. 

[0059] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by further 
changing the other image data format into still other 
image data format defining a third data transfer rate 
which is lower than the second data transfer rate when 
the monitoring unit still recognizes the delay in transfer 
of the multiplexed data on the communication line. 
[0060] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by returning 
the still other image data format into the other image 
data format when the monitoring unit recognizes no 
delay in transfer of the multiplexed data on the commu- 
nication line. 

[0061] It is also preferable that the controller unit fur- 
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ther controls the transfer of the image data by discontin- 
uing the transfer of the image data only when the 
monitoring unit still recognizes the delay in transfer of 
the multiplexed data on the communication line even 
after the controller unit changes the image data format 
into a final image data format defining a lowest data 
transfer rate. 

[0062] It is also preferable that the controller unit fur- 
ther controls the transfer of the image data by re-start- 
ing the image data transfer when the monitoring unit 
recognizes no delay in transfer of the multiplexed data 
on the communication line. 

[0063] It is also preferable that the monitoring unit and 
the controller unit are realized by a data controller pro- 
vided in each of the terminal devices. 

FIRST EMBODIMENT: 

[0064] A first embodiment according to the present 
invention will be described in detail with reference to 
FIG. 2 which is a block diagram illustrative of a novel 
video conference system for transferring image data 
and voice data through a general communication line 
between two terminal devices. The novel video confer- 
ence data transfer system comprises two terminal 
devices 1 and 15 and a communication line 14 connect- 
ing the two terminal devices 1 and 15 to each other or 
transferring image data and voice data for the video 
conference. The two terminal devices 1 and 15 will be 
referred to as a first terminal device 1 and a second ter- 
minal device 1 5 which have the same structure and con- 
figurations. The first and second terminal devices 1 and 
15 have first and second microphones 2 and 24 respec- 
tively for capturing voices. The first and second terminal 
devices 1 and 15 also have first and second cameras 3 
and 25 respectively for capturing images. The first and 
second terminal devices 1 and 15 also have first and 
second data compressors 6 and 22 respectively. The 
first compressor 6 is connected to the first microphone 
2 and the first camera 3 for receiving image data cap- 
tured by the first camera 3 and voice data captured by 
the first microphone 2 to compress the received image 
data and the received voice data. The second compres- 
sor 22 is also connected to the second microphone 24 
and the first camera 25 for receiving image data cap- 
tured by the second camera 25 and voice data captured 
by the second microphone 24 to compress the received 
image data and the received voice data. The first and 
second terminal devices 1 and 15 also have first and 
second multiplexers 8 and 20 respectively for multiplex- 
ing image data and voice data. The first multiplexer 8 is 
connected to the first data compressor 6 for receiving 
the compressed image data and the compressed voice 
data from the first data compressor 6 to multiplex the 
compressed image data and the compressed voice 
data. The second multiplexer 20 is connected to the 
second data compressor 22 for receiving the com- 
pressed image data and the compressed voice data 



from the second data compressor 22 to multiplex the 
compressed image data and the compressed voice 
data. The first and second terminal devices 1 and 15 
also have first and second transmission data buffers 1 1 

5 and 17 respectively for temporary storing the multi- 
plexed data. The first transmission data buffer 1 1 is con- 
nected to the first multiplexer 8 for receiving and 
temporary storing the multiplexed data. The second 
transmission data buffer 17 is connected to the second 

10 multiplexer 20 for receiving and temporary storing the 
multiplexed data. The first and second terminal devices 
1 and 15 also have first and second communication 
devices 13 and 16 respectively. The first and second 
communication devices 13 and 16 are connected to 

15 each other through the communication line 1 4. The first 
communication device 13 is connected to the first trans- 
mission data buffer 1 1 for receiving the first multiplexed 
data from the first transmission data buffer 1 1 to trans- 
mit the first multiplexed data through the communication 

20 line 1 4 to the second communication device 16. On the 
other hand, the second communication device 16 is 
connected to the second transmission data buffer 1 7 for 
receiving the second multiplexed data from the second 
transmission data buffer 1 7 to transmit the second mul- 

25 tiplexed data through the communication line 14 to the 
first communication device 13. The first communication 
device 1 3 receives the second multiplexed data from the 
second communication device 16, whilst the second 
communication device 16 receives the first multiplexed 

30 data from the first communication device 13. The first 
and second terminal devices 1 and 15 further have first 
and second receiving data buffers 12 and 18 respec- 
tively for temporary storing the received data. The first 
receiving data buffer 12 is connected to the first commu- 

35 nication device 13 for receiving the second multiplexed 
data from the first communication device 13 to tempo- 
rary store the second multiplexed data. The second 
receiving data buffer 13 is connected to the second 
communication device 16 for receiving the first multi- 

40 plexed data from the second communication device 16 
to temporary store the first multiplexed data. The first 
and second terminal devices 1 and 15 further have first 
and second demultiplexers 9 and 21 respectively for 
separating the multiplexed data into voice and image 

45 data. The first demultiplexer 9 is connected to the first 
receiving data buffer 12 for receiving the second multi- 
plexed data to demultiplex the second multiplexed data 
into second image data and second voice data sepa- 
rated from each other. The second demultiplexer 21 is 

so connected to the second receiving data buffer 18 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 
terminal devices 1 and 15 further have first and second 

55 decompressors 7 and 21 respectively for decompress- 
ing the image data and the voice data separately. The 
first decompressor 7 is connected to the first demulti- 
plexer 9 for receiving the second image data and the 
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second voice data to expend the second image data 
and the second voice data separately. The second 
decompressor 23 is connected to the second demulti- 
plexer 21 for receiving the first image data and the first 
voice data to expend the first image data and the first 
voice data separately. The first and second terminal 
devices 1 and 15 further have first and second speakers 
4 and 26 as well as first and second displays 5 and 27 
respectively for re-producing the voice data and the 
image data. The first speaker 4 is connected to the first 
decompressor 7 for receiving the second voice data 
from the first decompressor 7 to reproduce the second 
voice data as a voice. The first display 5 is also con- 
nected to the first decompressor 7 for receiving the sec- 
ond image data from the first decompressor 7 to 
reproduce the second image data on a screen of the 
first display 5. The second speaker 26 is connected to 
the second decompressor 23 for receiving the first voice 
data from the second decompressor 23 to reproduce 
the first voice data as a voice. The second display 27 is 
also connected to the second decompressor 23 for 
receiving the first image data from the second decom- 
pressor 23 to reproduce the first image data on a screen 
of the second display 27. 

[0065] The first and second terminal devices 1 and 15 
also have first and second data controllers 10-1 and 19- 
1 respectively. The first data controller 10-1 has both a 
monitoring function for monitoring a current state of 
transfer of the image data and voice data through the 
general communication line 14 and a controlling func- 
tion for controlling transfers of the image data and the 
voice data, so that a priority is given to the transfer of the 
voice data whilst the transfer of the image data is con- 
trolled or discontinued in order to continue a current 
transfer of the voice data when the controller recognizes 
a delay in transfer of multiplexed data containing the 
image and voice data on the general communication 
line 14. The second data controller 19-1 has both a 
monitoring function for monitoring a current state of 
transfer of the image data and voice data through the 
general communication line 14 and a controlling func- 
tion for controlling transfers of the image data and the 
voice data, so that a priority is given to the transfer of the 
voice data whilst the transfer of the image data is con- 
trolled or discontinued in order to continue a current 
transfer of the voice data when the controller recognizes 
a delay in transfer of multiplexed data containing the 
image and voice data on the general communication 
line 1 4. The first data controller 10-1 is connected to the 
first communication device 13 for receiving an informa- 
tion about an amount of the multiplexed data accumu- 
lated in the first transmitting side data buffer 11 for 
subsequent transfer through the communication line 14 
in order to monitor, through the first communication 
device 13, the amount of the multiplexed data accumu- 
lated in the first transmitting side data buffer 1 1 , so that 
only when the amount of the multiplexed data accumu- 
lated in the first transmitting side data buffer 1 1 exceeds 



a predetermined level, then the above control function 
of the first data controller 10-1 is activated. The second 
data controller 19-1 is also connected to the second 
communication device 16 for receiving an information 

5 about an amount of the multiplexed data accumulated in 
the second transmitting side data buffer 17 for subse- 
quent transfer through the communication line 14 in 
order to monitor, through the first communication device 
16, the amount of the multiplexed data accumulated in 

10 the second transmitting side data buffer 1 7, so that only 
when the amount of the multiplexed data accumulated 
in the second transmitting side data buffer 17 exceeds a 
predetermined level, then the above control function of 
the second data controller 19-1 is activated. The first 

15 data controller 10-1 is further connected to the first com- 
pressor 6 to send the first compressor 6 an instruction 
of changing an image data compression format in order 
to control the transfer of the image data by changing an 
original image data format defining a first data transfer 

20 rate as a normal data transfer rate to other image data 
format defining a second data transfer rate which is 
lower than the first data transfer rate when the first data 
controller 10-1 recognizes the delay in transfer of the 
image data and the voice data on the communication 

25 line in accordance with the information about the data 
accumulation in the first transmitting side data buffer 1 1 
supplied from the first communication device 13. The 
second data controller 19-1 is further connected to the 
second compressor 22 to send the second compressor 

30 22 an instruction of changing an image data compres- 
sion format in order to control the transfer of the image 
data by changing an original image data format defining 
a first data transfer rate as a normal data transfer rate to 
other image data format defining a second data transfer 

35 rate which is lower than the first data transfer rate when 
the second data controller 19-1 recognizes the delay in 
transfer of the image data and the voice data on the 
communication line in accordance with the information 
about the data accumulation in the second transmitting 

40 side data buffer 1 7 supplied from the second communi- 
cation device 16. The first data controller 10-1 further 
controls the transfer of the image data by returning the 
other image data format into the original image data for- 
mat when the first data controller 10-1 recognizes no 

45 delay in transfer of the image data and the voice data on 
the general communication line 14. The second data 
controller 19-1 further controls the transfer of the image 
data by returning the other image data format into the 
original image data format when the second data con- 

50 troller 19-1 recognizes no delay in transfer of the image 
data and the voice data on the general communication 
line 14. The first data controller 10-1 further controls the 
transfer of the image data by further changing the other 
image data format into still other image data format 

5 5 defining a third data transfer rate which is lower than the 
second data transfer rate when the first data controller 
10-1 still recognizes the delay in transfer of the image 
data and the voice data on the general communication 
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line 14. The second data controller 19-1 further controls 
the transfer of the image data by further changing the 
other image data format into still other image data for- 
mat defining a third data transfer rate which is lower 
than the second data transfer rate when the second 5 
data controller 1 9-1 still recognizes the delay in transfer 
of the image data and the voice data on the general 
communication line 14. The first data controller 10-1 fur- 
ther controls the transfer of the image data by returning 
the still other image data format into the other image 
data format when the first data controller 10-1 recog- 
nizes no delay in transfer of the image data and the 
voice data on the general communication line 14. The 
second data controller 19-1 further controls the transfer 
of the image data by returning the still other image data 
format into the other image data format when the sec- 
ond data controller 19-1 recognizes no delay in transfer 
of the image data and the voice data on the general 
communication line 14. The first data controller 10-1 fur- 
ther controls the transfer of the image data by discontin- 
uing the transfer of the image data only when the first 
data controller 1 0-1 still recognizes the delay in transfer 
of the image data and the voice data on the general 
communication line 14 even after the first data controller 
10-1 changes the image data format into a final image 
data format defining a lowest data transfer rate. The 
second data controller 19-1 further controls the transfer 
of the image data by discontinuing the transfer of the 
image data only when the second data controller 19-1 
still recognizes the delay in transfer of the image data 
and the voice data on the general communication line 
14 even after the second data controller 19-1 changes 
the image data format into a final image data format 
defining a lowest data transfer rate. The first data con- 
troller 10-1 further controls the transfer of the image 
data by re-starting the image data transfer when the first 
data controller 10-1 recognizes no delay in transfer of 
the image data and the voice data on the general com- 
munication line 14. The second data controller 19-1 fur- 
ther controls the transfer of the image data by re- 
starting the image data transfer when the second data 
controller 19-1 recognizes no delay in transfer of the 
image data and the voice data on the general communi- 
cation line 14. The first data controller 10-1 controls the 
current transfer of the voice data only when the first data 
controller 10-1 still recognizes the delay in transfer of 
the image data and the voice data on the general com- 
munication line 1 4 even the transfer of the image data is 
discontinued, wherein the first data controller 10-1 
sends the first compressor 6 an instruction of changing 
an original voice data compression format into other 
voice data compression format which is lower than the 
original voice data compression format, in order to con- 
trol the transfer of the voice data. The second data con- 
troller 19-1 controls the current transfer of the voice data 
only when the second data controller 19-1 still recog- 
nizes the delay in transfer of the image data and the 
voice data on the general communication line 14 even 



the transfer of the image data is discontinued, wherein 
the second data controller 19-1 sends the second com- 
pressor 22 an instruction of changing an original voice 
data compression format into other voice data compres- 
sion format which is lower than the original voice data 
compression format, in order to control the transfer of 
the voice data. 

SECOND EMBODIMENT: 

[0066] A second embodiment according to the present 
invention will be described in detail with reference to 
FIG. 3 which is a block diagram illustrative of a novel 
video conference system for transferring image data 
and voice data through a general communication line 
between two terminal devices. The novel video confer- 
ence data transfer system comprises two terminal 
devices 1 and 15 and a communication line 14 connect- 
ing the two terminal devices 1 and 15 to each other or 
transferring image data and voice data for the video 
conference. The two terminal devices 1 and 15 will be 
referred to as a first terminal device 1 and a second ter- 
minal device 1 5 which have the same structure and con- 
figurations. The first and second terminal devices 1 and 
15 have first and second microphones 2 and 24 respec- 
tively for capturing voices. The first and second terminal 
devices 1 and 15 also have first and second cameras 3 
and 25 respectively for capturing images. The first and 
second terminal devices 1 and 15 also have first and 
second data compressors 6 and 22 respectively. The 
first compressor 6 is connected to the first microphone 
2 and the first camera 3 for receiving image data cap- 
tured by the first camera 3 and voice data captured by 
the first microphone 2 to compress the received image 
data and the received voice data. The second compres- 
sor 22 is also connected to the second microphone 24 
and the first camera 25 for receiving image data cap- 
tured by the second camera 25 and voice data captured 
by the second microphone 24 to compress the received 
image data and the received voice data. The first and 
second terminal devices 1 and 15 also have first and 
second multiplexers 8 and 20 respectively for multiplex- 
ing image data and voice data. The first multiplexer 8 is 
connected to the first data compressor 6 for receiving 
the compressed image data and the compressed voice 
data from the first data compressor 6 to multiplex the 
compressed image data and the compressed voice 
data. The second multiplexer 20 is connected to the 
second data compressor 22 for receiving the com- 
pressed image data and the compressed voice data 
from the second data compressor 22 to multiplex the 
compressed image data and the compressed voice 
data. The first and second terminal devices 1 and 15 
also have first and second transmission data buffers 1 1 
and 17 respectively for temporary storing the multi- 
plexed data. The first transmission data buffer 1 1 is con- 
nected to the first multiplexer 8 for receiving and 
temporary storing the multiplexed data. The second 
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transmission data buffer 17 is connected to the second 
multiplexer 20 for receiving and temporary storing the 
multiplexed data. The first and second terminal devices 
1 and 15 also have first and second communication 
devices 13 and 16 respectively. The first and second 
communication devices 13 and 16 are connected to 
each other through the communication line 1 4. The first 
communication device 1 3 is connected to the first trans- 
mission data buffer 1 1 for receiving the first multiplexed 
data from the first transmission data buffer 1 1 to trans- 
mit the first multiplexed data through the communication 
line 14 to the second communication device 16. On the 
other hand, the second communication device 16 is 
connected to the second transmission data buffer 1 7 for 
receiving the second multiplexed data from the second 
transmission data buffer 1 7 to transmit the second mul- 
tiplexed data through the communication line 14 to the 
first communication device 13. The first communication 
device 1 3 receives the second multiplexed data from the 
second communication device 16, whilst the second 
communication device 16 receives the first multiplexed 
data from the first communication device 13. The first 
and second terminal devices 1 and 15 further have first 
and second receiving data buffers 12 and 18 respec- 
tively for temporary storing the received data. The first 
receiving data buffer 12 is connected to the first commu- 
nication device 13 for receiving the second multiplexed 
data from the first communication device 13 to tempo- 
rary store the second multiplexed data. The second 
receiving data buffer 13 is connected to the second 
communication device 16 for receiving the first multi- 
plexed data from the second communication device 16 
to temporary store the first multiplexed data. The first 
and second terminal devices 1 and 15 further have first 
and second demultiplexers 9 and 21 respectively for 
separating the multiplexed data into voice and image 
data. The first demultiplexer 9 is connected to the first 
receiving data buffer 12 for receiving the second multi- 
plexed data to demultiplex the second multiplexed data 
into second image data and second voice data sepa- 
rated from each other. The second demultiplexer 21 is 
connected to the second receiving data buffer 18 for 
receiving the first multiplexed data to demultiplex the 
first multiplexed data into first image data and first voice 
data separated from each other. The first and second 
terminal devices 1 and 15 further have first and second 
decompressors 7 and 21 respectively for decompress- 
ing the image data and the voice data separately. The 
first decompressor 7 is connected to the first demulti- 
plexer 9 for receiving the second image data and the 
second voice data to expend the second image data 
and the second voice data separately. The second 
decompressor 23 is connected to the second demulti- 
plexer 21 for receiving the first image data and the first 
voice data to expend the first image data and the first 
voice data separately. The first and second terminal 
devices 1 and 15 further have first and second speakers 
4 and 26 as well as first and second displays 5 and 27 



respectively for re-producing the voice data and the 
image data. The first speaker 4 is connected to the first 
decompressor 7 for receiving the second voice data 
from the first decompressor 7 to reproduce the second 

5 voice data as a voice. The first display 5 is also con- 
nected to the first decompressor 7 for receiving the sec- 
ond image data from the first decompressor 7 to 
reproduce the second image data on a screen of the 
first display 5. The second speaker 26 is connected to 

10 the second decompressor 23 for receiving the first voice 
data from the second decompressor 23 to reproduce 
the first voice data as a voice. The second display 27 is 
also connected to the second decompressor 23 for 
receiving the first image data from the second decom- 

15 pressor 23 to reproduce the first image data on a screen 
of the second display 27. 

[0067] The first and second terminal devices 1 and 1 5 
also have first and second data controllers 1 0-2 and 19- 
2 respectively. The first data controller 10-2 has both a 

20 monitoring function for monitoring a load of a first CPU 
provided in the first compressor 6 in the first terminal 
device 1 for data compressing operations and a control- 
ling function for controlling processing speeds of the 
image data and the voice data by the first CPU, so that 

25 the priority is given to the processing of the voice data 
by the first CPU whilst the processing of the image data 
by the first CPU is controlled or discontinued in order to 
continue the current processing speed of the voice data 
by the first CPU when the first data controller 10-2 rec- 

30 ognizes an over-load of the first CPU. The second data 
controller 19-2 has both a monitoring function for moni- 
toring a load of a second CPU provided in the second 
compressor 22 in the second terminal device 15 for data 
compressing operations and a controlling function for 

35 controlling processing speeds of the image data and the 
voice data by the second CPU, so that the priority is 
given to the processing of the voice data by the second 
CPU whilst the processing of the image data by the sec- 
ond CPU is controlled or discontinued in order to con- 

40 tinue the current processing speed of the voice data by 
the second CPU when the second data controller 19-2 
recognizes an over-load of the second CPU. The first 
data controller 10-2 is connected to the first communi- 
cation device 13 for receiving, through the first commu- 

45 nication device 13, about informations of an amount of 
the image data and the voice data accumulated in the 
first transmitting side data buffer 11 for subsequent 
transfer through the general communication line 14 in 
order to monitor the amount of the accumulated image 

so and voice data, so that only when the amount of the 
image and voice data accumulated in the first transmit- 
ting side data buffer 1 1 is less than a predetermined 
level, then the control function of the first data controller 
10-2 is activated. The second data controller 19-2 is 

55 connected to the second communication device 16 for 
receiving, through the second communication device 
16, about informations of an amount of the image data 
and the voice data accumulated in the second transmit- 
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ting side data buffer 17 for subsequent transfer through 
the general communication line 14 in order to monitor 
the amount of the accumulated image and voice data, 
so that only when the amount of the image and voice 
data accumulated in the second transmitting side data 5 
buffer 17 is less than a predetermined level, then the 
control function of the second data controller 19-2 is 
activated. The first data controller 10-2 is also con- 
nected to the first data compressor 6 for sending the 
first data compressor 6 an instruction to change an orig- 10 
inal image data processing speed format defining a first 
image data processing speed as a normal image data 
processing speed to other image data processing 
speed format defining a second image data processing 
speed which is lower than the first image data process- 15 
ing speed when the first data controller 10-2 recognizes 
the over-load of the first CPU, so as to control the 
processing speed of the image data. The second data 
controller 19-2 is also connected to the second data 
compressor 22 for sending the second data compressor 20 
22 an instruction to change an original image data 
processing speed format defining a first image data 
processing speed as a normal image data processing 
speed to other image data processing speed format 
defining a second image data processing speed which 2 s 
is lower than the first image data processing speed 
when the second data controller 19-2 recognizes the 
over-load of the second CPU, so as to control the 
processing speed of the image data. The first data con- 
troller 10-2 further controls the processing speed of the 30 
image data by returning the other image data process- 
ing speed format into the original image data process- 
ing speed format when the first data controller 10-2 
recognizes no over-load of the first CPU. The second 
data controller 19-2 further controls the processing 35 
speed of the image data by returning the other image 
data processing speed format into the original image 
data processing speed format when the second data 
controller 19-2 recognizes no over-load of the second 
CPU. The first data controller 10-2 further controls the 40 
processing speed of the image data by sending the first 
data compressor 6 an instruction of further changing the 
other image data processing speed format into still 
other image data processing speed format defining a 
third data processing speed which is lower than the sec- 45 
ond data processing speed when the first data controller 
10-2 still recognizes the over-load of the first CPU. The 
second data controller 19-2 further controls the 
processing speed of the image data by sending the sec- 
ond data compressor 22 an instruction of further chang- 50 
ing the other image data processing speed format into 
still other image data processing speed format defining 
a third data processing speed which is lower than the 
second data processing speed when the second data 
controller 19-2 still recognizes the over-load of the sec- 55 
ond CPU. The first data controller 10-2 further controls 
the processing speed of the image data by returning the 
still other image data processing speed format into the 



other image data processing speed format when the 
first data controller 10-2 recognizes no over-load of the 
first CPU. The second data controller 10-2 further con- 
trols the processing speed of the image data by return- 
ing the still other image data processing speed format 
into the other image data processing speed format 
when the second data controller 19-2 recognizes no 
over-load of the second CPU. The first data controller 
10-2 further controls the processing speed of the image 
data by sending the first data compressor 6 an instruc- 
tion of discontinuing the data compression processing 
of the image data only when the first data controller 10- 
2 still recognizes the over-load of the first CPU even 
after the first data controller 10-2 has changed the 
image data processing speed format into a final image 
data processing speed format defining a lowest data 
processing speed. The second data controller 19-2 fur- 
ther controls the processing speed of the image data by 
sending the second data compressor 22 an instruction 
of discontinuing the data compression processing of the 
image data only when the second data controller 19-2 
still recognizes the over-load of the second CPU even 
after the second data controller 19-2 has changed the 
image data processing speed format into a final image 
data processing speed format defining a lowest data 
processing speed. The first data controller 10-2 further 
controls the processing speed of the image data by re- 
starting the still other image data compression process- 
ing when the controller recognizes no over-load of the 
first CPU. The second data controller 19-2 further con- 
trols the processing speed of the image data by re-start- 
ing the still other image data compression processing 
when the controller recognizes no over-load of the sec- 
ond CPU. The first data controller 10-2 controls the cur- 
rent processing speed of the voice data by sending the 
first data compressor 6 an instruction of changing an 
original voice data compression format defining a first 
data compression rate as a normal data compression 
rate into another voice data compression format defin- 
ing a second data compression rate which is lower than 
the first data compression rate only when the first data 
controller 10-2 still recognizes the over-load of the first 
CPU even after the processing of compression of the 
image data has been discontinued. The second data 
controller 19-2 controls the current processing speed of 
the voice data by sending the second data compressor 
22 an instruction of changing an original voice data 
compression format defining a first data compression 
rate as a normal data compression rate into another 
voice data compression format defining a second data 
compression rate which is lower than the first data com- 
pression rate only when the second data controller 19-2 
still recognizes the over-load of the second CPU even 
after the processing of compression of the image data 
has been discontinued. 

[0068] Whereas modifications of the present invention 
will be apparent to a person having ordinary skill in the 
art, to which the invention pertains, it is to be under- 
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stood that embodiments as shown and described by 
way of illustrations are by no unit intended to be consid- 
ered in a limiting sense. Accordingly, it is to be intended 
to cover by claims all modifications which fall within the 
spirit and scope of the present invention. 

Claims 

1 . A system for transferring multiplexed data including 
image data and voice data through at least a com- 
munication line between at least two terminal 
devices, characterized in that said system includes: 

a monitoring means for monitoring a current 
state of transfer of said multiplexed data on 
said communication line ; and 
a controller means for controlling transfers of 
said image data and said voice data, so that a 
priority is given to said transfer of said voice 
data whilst said transfer of said image data is 
controlled or discontinued in order to continue 
a current transfer of said voice data when said 
monitoring means recognizes a delay in trans- 
fer of said multiplexed data on said communi- 
cation line. 

2. The system as claimed in claim 1 , characterized in 
that said controller means controls said current 
transfer of said voice data only when said monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said communication line 
even after said transfer of said image data has been 
discontinued. 

3. The system as claimed in claim 1 , characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means exceeds a predeter- 
mined level, then said controller means performs 
said control operation. 

4. The system as claimed in claim 1 , characterized in 
that said controller means controls said transfer of 
said image data by changing an original image data 
format defining a first data transfer rate as a normal 
data transfer rate to other image data format defin- 
ing a second data transfer rate which is lower than 
said first data transfer rate when said monitoring 
means recognizes said delay in transfer of said 
multiplexed data on said communication line. 

5. The system as claimed in claim 4, characterized in 
that said controller means further controls said 
transfer of said image data by returning said other 
image data format into said original image data for- 



mat when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

5 6. The system as claimed in claim 4, characterized in 
that said controller means further controls said 
transfer of said image data by further changing said 
other image data format into still other image data 
format defining a third data transfer rate which is 

10 lower than said second data transfer rate when said 
monitoring means still recognizes said delay in 
transfer of said multiplexed data on said communi- 
cation line. 

15 7. The system as claimed in claim 6, characterized in 
that said controller means further controls said 
transfer of said image data by returning said still 
other image data format into said other image data 
format when said monitoring means recognizes no 

20 delay in transfer of said multiplexed data on said 
communication line. 

8. The system as claimed in claim 4, characterized in 
that said controller means further controls said 

25 transfer of said image data by discontinuing said 
transfer of said image data only when said monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said communication line 
even after said controller means changes said 

30 image data format into a final image data format 
defining a lowest data transfer rate. 

9. The system as claimed in claim 8, characterized in 
that said controller means further controls said 

35 transfer of said image data by re-starting said still 
other image data format when said monitoring 
means recognizes no delay in transfer of said multi- 
plexed data on said communication line. 

40 10. The system as claimed in claim 1 , characterized in 
that said monitoring means and said controller 
means are realized by a data controller provided in 
each of said terminal devices. 

45 11. The system as claimed in claim 1, characterized in 
that monitoring means further monitors a load of a 
processor provided in each of said terminal devices 
for permitting said controller means to control 
processing speeds of said image data and said 

so voice data by said processor, so that said priority is 
given to said processing of said voice data whilst 
said processing of said image data is controlled or 
discontinued in order to continue said current 
processing speed of said voice data when said 

55 monitoring means recognizes an over-load of said 
processor. 

12. The system as claimed in claim 1 1 , characterized in 
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that said controller means controls said current 
processing speed of said voice data only when said 
controller means still recognizes said over-load of 
said processor even after said processing of said 
image data has been discontinued. 

13. The system as claimed in claim 1 1 , characterized in 
that said monitoring means is operated to monitor 
an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means is less than a predeter- 
mined level, then said controller means performs 
said control operation. 

14. The system as claimed in claim 1 1 , characterized in 
that said controller means controls said processing 
speed of said image data by changing an original 
image data processing speed format defining a first 
data processing speed as a normal data process- 
ing speed to other image data processing speed 
format defining a second data processing speed 
which is lower than said first data processing speed 
when said monitoring means recognizes said over- 
load of said processor. 

15. The system as claimed in claim 14, characterized in 
that said controller means further controls said 
processing speed of said image data by returning 
said other image data processing speed format into 
said original image data processing speed format 
when said monitoring means recognizes no over- 
load of said processor. 

16. The system as claimed in claim 14, characterized in 
that said controller means further controls said 
processing speed of said image data by further 
changing said other image data processing speed 
format into still other image data processing speed 
format defining a third data processing speed which 
is lower than said second data processing speed 
when said monitoring means still recognizes said 
over-load of said processor. 

17. The system as claimed in claim 16, characterized in 
that said controller means further controls said 
processing speed of said image data by returning 
said still other image data processing speed format 
into said other image data processing speed format 
when said monitoring means recognizes no over- 
load of said processor. 

18. The system as claimed in claim 14, characterized in 
that said controller means further controls said 
processing speed of said image data by discontinu- 
ing said processing of said image data only when 
said monitoring means still recognizes said over- 



load of said processor even after said controller 
means changes said image data processing speed 
format into a final image data processing speed for- 
mat defining a lowest data processing speed. 

5 

19. The system as claimed in claim 18, characterized in 
that said controller means further controls said 
processing speed of said image data by re-starting 
said still other image data compression processing 

10 when said monitoring means recognizes no over- 
load of said processor. 

20. The system as claimed in claim 1 1 , characterized in 
that said controller means controls said processing 

15 speed of said image data by controlling an opera- 
tion of a compressor provided each of said terminal 
devices. 

21. A system for transferring multiplexed data including 
20 image data and voice data through at least a com- 
munication line between at least two terminal 
devices, characterized in that said system includes 



25 a monitoring means for monitoring a load of a 

processor provided in each of said terminal 
devices ; and 

a controller means for controlling processing 
speeds of said image data and said voice data, 

30 so that said priority is given to said processing 

of said voice data whilst said processing of said 
image data is controlled or discontinued in 
order to continue said current processing 
speed of said voice data when said monitoring 

35 means recognizes an over-load of said proces- 

sor. 

22. The system as claimed in claim 21 , characterized in 
that said controller means controls said current 

40 processing speed of said voice data only when said 
processing of said image data is discontinued. 

23. The system as claimed in claim 21 , characterized in 
that said monitoring means is operated to monitor 

45 an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means is less than a predeter- 

50 mined level, then said controller means performs 
said control operation. 

24. The system as claimed in claim 21 , characterized in 
that said controller means controls said processing 

55 speed of said image data by changing an original 
image data processing speed format defining a first 
data processing speed as a normal data process- 
ing speed to other image data processing speed 
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format defining a second data processing speed 
which is lower than said first data processing speed 
when said monitoring means recognizes said over- 
load of said processor. 

25. The system as claimed in claim 24, characterized in 
that said controller means further controls said 
processing speed of said image data by returning 
said other image data processing speed format into 
said original image data processing speed format 
when said monitoring means recognizes no over- 
load of said processor. 

26. The system as claimed in claim 24, characterized in 
that said controller means further controls said 
processing speed of said image data by further 
changing said other image data processing speed 
format into still other image data processing speed 
format defining a third data processing speed which 
is lower than said second data processing speed 
when said monitoring means still recognizes said 
over-load of said processor. 

27. The system as claimed in claim 26, characterized in 
that said controller means further controls said 
processing speed of said image data by returning 
said still other image data processing speed format 
into said other image data processing speed format 
when said monitoring means recognizes no over- 
load of said processor. 

28. The system as claimed in claim 24, characterized in 
that said controller means further controls said 
processing speed of said image data by discontinu- 
ing said processing of said image data only when 
said monitoring means still recognizes said over- 
load of said processor even after said controller 
means changes said image data processing speed 
format into a final image data processing speed for- 
mat defining a lowest data processing speed. 

29. The system as claimed in claim 28, characterized in 
that said controller means further controls said 
processing speed of said image data by re-starting 
said still other image data compression processing 
when said monitoring means recognizes no over- 
load of said processor. 

30. The system as claimed in claim 21 , characterized in 
that said controller means controls said processing 
speed of said image data by controlling an opera- 
tion of a compressor provided each of said terminal 
devices. 

31 . The system as claimed in claim 21 , characterized in 
that said monitoring means further monitors a cur- 
rent state of transfer of said multiplexed data on 
said communication line so as to permit said con- 



troller means to further control transfers of said 
image data and said voice data, so that a priority is 
given to said transfer of said voice data whilst said 
transfer of said image data is controlled or discon- 
5 tinued in order to continue a current transfer of said 

voice data when said monitoring means recognizes 
a delay in transfer of said multiplexed data on said 
communication line. 

10 32. The system as claimed in claim 31 , characterized in 
that said controller means controls said current 
transfer of said voice data only when said monitor- 
ing means still recognizes said delay in transfer of 
said multiplexed data on said communication line 

15 even after said transfer of said image data has been 
discontinued. 

33. The system as claimed in claim 31 , characterized in 
that said monitoring means is operated to monitor 

20 an amount of said multiplexed data accumulated in 
a data storage means for subsequent transfer 
through said communication line so that only when 
said amount of said multiplexed data accumulated 
in said data storage means exceeds a predeter- 

25 mined level, then said controller means performs 
said control operation. 

34. The system as claimed in claim 31 , characterized in 
that said controller means controls said transfer of 

30 said image data by changing an original image data 
format defining a first data transfer rate as a normal 
data transfer rate to other image data format defin- 
ing a second data transfer rate which is lower than 
said first data transfer rate when said monitoring 

35 means recognizes said delay in transfer of said 
multiplexed data on said communication line. 

35. The system as claimed in claim 34, characterized in 
that said controller means further controls said 

40 transfer of said image data by returning said other 
image data format into said original image data for- 
mat when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

45 

36. The system as claimed in claim 34, characterized in 
that said controller means further controls said 
transfer of said image data by further changing said 
other image data format into still other image data 

so format defining a third data transfer rate which is 
lower than said second data transfer rate when said 
monitoring means still recognizes said delay in 
transfer of said multiplexed data on said communi- 
cation line. 

55 

37. The system as claimed in claim 36, characterized in 
that said controller means further controls said 
transfer of said image data by returning said still 
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other image data format into said other image data 
format when said monitoring means recognizes no 
delay in transfer of said multiplexed data on said 
communication line. 

5 

38. The system as claimed in claim 34, characterized in 
that said controller means further controls said 
transfer of said image data by discontinuing said 
transfer of said image data only when said monitor- 
ing means still recognizes said delay in transfer of 10 
said multiplexed data on said communication line 
even after said controller means changes said 
image data format into a final image data format 
defining a lowest data transfer rate. 

15 

39. The system as claimed in claim 38, characterized in 
that said controller means further controls said 
transfer of said image data by re-starting said still 
other image data format when said monitoring 
means recognizes no delay in transfer of said multi- 20 
plexed data on said communication line. 

40. The system as claimed in claim 31 , characterized in 
that said monitoring means and said controller 
means are realized by a data controller provided in 25 
each of said terminal devices. 
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51 : first terminal device 52 : first microphone 

53 : first camera 54 : first speaker 

55 : first display 56 : first data compressor 

57 : first data decompressor 58 : first multiplexer 

59 : first demultiplexer 60 : first transmitting side data buffer 

61 : first receiving side data buffer 62 : first communication device 

63 : general communication line 64 : second communication device 

65 : second terminal device 66 : second transmitting side data buffer 

67 : second receiving side data buffer 68 : second multiplexer 

69 : second demultiplexer 70 : second data compressor 

71 : second data decompressor 72 : second microphone 

73 : second camera 74 : second speaker 

75 : second display 
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FIG. 2 
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1 : first terminal device 

3 ; first camera 

5 : first display 

7 : first data decompressor 

9 : first demultiplexer 
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2 : first microphone 
4 : first speaker 
6 : first data compressor 
8 : first multiplexer 
10-1 : first data controller 



11 : first transmitting side data buffer 12 : first receiving side data buffer 
13 : first communication device 14 : general communication line 
15 : second terminal device 16 : second communication device 

17 : second transmitting side data buffer 

18 : second receiving side data buffer 

19-1 : second data controller 20 : second multiplexer 
21 : second demultiplexer 22 : second data compressor 

23 : second data decompressor 24 : second microphone 
25 : second camera 26 : second speaker 

27 : second display 
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FIG. 3 
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1 : first terminal device 
3 : first camera 
5 : first display 
7 : first data decompressor 
9 ; first demultiplexer 



2 : first microphone 
4 : first speaker 
6 : first data compressor 
8 : first multiplexer 
10-2 : first data controller 



11 : first transmitting side data buffer 12 : first receiving side data buffer 
13 : first communication device 14 : general communication line 
15 : second terminal device 16 : second communication device 

17 : second transmitting side data buffer 

18 : second receiving side data buffer 

19-2 : second data controller 20 : second multiplexer 
21 : second demultiplexer 22 : second data compressor 

23 : second data decompressor 24 : second microphone 
25 ; second camera 26 : second speaker 

27 : second display 
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